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Trrhnir^' ^'^''^ 

ofthe foreground image. 

niiliiiiiimfinfthf^""^"^"'^ 

perhaps, hundreds of times per day. For example. 3,,^ „rfin„ 

:echno,„^ess.ehasd.eh,.er„e,,h„si„esspersons,s«d*^^^^^^ 

eUizer,s routinely »nsmi. and receive di^.a. .mages ,„ .he „o™^ c ^^^^ 

. ,, i„a.es have become a staple in modem soerety, ever Chang g 
20 Thus, smce d,g,.al .mages ha ^^^^^ 
sophisticated requirements for image processing ar 

designers and architects. „ u »«^ociated with seamlessly 

0„esuchchallengerelating.oimageprocess,ng.sa^c,ated 

■ f . fir,t imaae with portions of a second .mage. For example, w 
combiningpor..onsofafi.t.magew P ^ 

25 „bservi„g.he„igh.lyweatherreport,the,mageofth ^ ,ase of high-tech 

aplurahtyofhacVgroundscreensdepictingvanousweath^patte^^^^^ 

„„v.especi.e.ectsa„.oro.h.»mpu.^^^^^^ 

rrz^tr— ^^^^^ 
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„h .he new background scene was Ae original background. Unfortunately, 
:o!:;;C<^-.s..e.ns.an,Un,esdo„„.e«^ 

lesucbl— alrnodelforextractingforegroundi^^^^ 
.30cla.edbackgroundre,„nre,a.es.ou.n.ingana„,«^^^^^ 
.ackground(.,.,b.„escree„,,ande.trac,lng..e.re^— 
,..^undW.aback.ou„dsubt..— 

^^^^^ 

.„ .he conventional nrodel, gWen the known background p,xe, values of dte 

.„ac„n.pared.oap.d— 

— rle.su,..sahove.hepredete™^^^^^ 

„ffW imase and enable smooth placemen, of .he loregtouno o 
regions of .he image ana ena ,,,.,„ ..klnescreen" reflections m 

Someoffl.eproblemsassocia.edwi.hU,ese.echniquesrela.e,o bluesaeen 

:eele.;foregronna,po.ential"ho,es.M„d,eforegrou„d,wherei„^^^^^^^^ 

„da„dbackgrou„daremixed,iaggededgesa,ongU,econ.oursohee^^ 

■ and "bleeding" of .he previous background in.o .he new background. Moreover, 
'::rgItcLhac;ou„dsisoflenno..ssib,ean.ord« 

Z view of .he above problems ass„cia.ed wi.h convenHona. image process, g 
r eed for a sys.em and/or mchodology to fac,li.a.e precise exttacon of a 
l..-a.edbaek.oundre.on,and.oenab,e.^^^ 

migra.ion of *e foreground region to other background reg,ons. 
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giiimnarY"f*''''^"v«'"tion 

• lifiprl .ummarv of the invention in order to provide a 
The following presents a simplified summary 

concepts of the invention m a simplified fom. as pr 

ftat is presented later. ^^„„3 „f 

l,ac..ound..„ns.»asn.p,xe,ea.^ 

:r::::re::Lo.ee.acted..a.e.e.o„. 
:r"::Uot.a„danda.^^^^^^^^^ 

• . f hnth a foreground color and a background color. 1 his mixiu 
generally a nnxtnre of oth a fore^ ^ ^^^^ , 

modeled linearly as follows. I - oF + (1 * ^ ^ 

J 1 n^ctiiPhackeroundcolor, andaistlieaipnavdiu<. 
theforegroundeolor.Brsthebackgron .^e I value is known from a given 

mixing ratio of foreground and background colors. Smce 

■™^^'::re:irC— maydete^ine.asfollow. t.^^^^^^ 
.,„cmayJselectedas.beeo,or<or.n.ensityva,ue).«ap.xe^^^^ 

--'■'^-'--rrnrzrside— 

similar value. Thus, accoraing u i= to be appreciated that there 

P--a.beborro.ed.omthenearestfore.^^^^^^^^^ 

are many other possibilities for determming the F value, 

■ Au .nnnnntine a local edge orientation and sub-pixel 
Th^ n value may be determmed by computing a locai cug 
.,gj:::o::edltbeeo„touroftbeext.c.ed.mage.™smaybeac.evedl.y 
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computing image gradients and edge locations ..lating to the geometry, direction, and 
:irrcoL.Porexampie,sn^^^^^^^ 

~.aaient and intensity .adientma^itude for eacHcontourpi,. and .socta^ 

Z n ilborhood. Tlte intensity gradient enables computation of the onentatton of t e 
CoTalourpixeUfanedgee^sts. —gradientma^itudesaret^^^^^^^^^^ 

dirltion perpendicular to the edge orientation. M optional an.sotrop.c smoothm m ^ 
etLildirectionparallelt„.heedseoHen.a,ion.Acurve,itisthenapph«..o.^^^^ 
be apphed m ^^^^ ^te edge s 

:;:f:r3::t:::.heco„to:rpi.,maythe„hedete™,„ed.The— 

Ithatoverlapsthefore^oundsiaeoftheHnedra^nwithcomputedon^ 
te" therefore . Thus, improved image extraction from abackground regron may be 

:r:o™e„tion:isystems.l.U.^ 
lly selected asdescribedaboveforKwhende.ermining.pha.A,pha.s.en 

a:enni„edaslm,nusthefract,onofthepi.el.hatover,apsthebac.^ounds,deof.heh„e 

drawn with computed orientation and offset. f„, selecting a 

to accordance with one aspect of the present invenhon, a system for select ng 
foregrol e,onofanimase,sive„asetofpixelsde.iningthebounda.yof,heforegrouud 

:;:noftheLge,isprovided.Thesys.emincMesacompone„ttodeterm..^^^^^^^ 
f ' ound value (F) and opacity value (a) for each pixel on the set wherem a ■ de ermm^J 
T , dl offset to facilitate a separation the foreground region from background 

""*"Lrdins.oanotheraspectofthepresentinventio„.ame.hodforin.egrating 
extract^mages sprovided. Themethodincludes..se,e.ingaset„f.ntourp.x*defmmg 

t;ounde,o„ofanimage.,detennini„gasubpixeledgeo,fset,^mthecent.^^ 
j:::p.xel;:dde.enn,„,nga„area„faport,onofeachcontourpixelnt..ngtbe 

subpixel edge offset to determine an opacity value (a) for each contour p.xel. 
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.t of the oresent invention, a system for integrating 
According to yet another aspect of the prese ^^^^^^^^^ 
■A^A Thp wstem includes: means tor seiecnng a 

each contour pixel. oresent invention, a signalis employed that 

U, accordance with another aspect „«,e ^ 
facilitatesintegrationofex,racted,™ses.Ue^ - 

„itha„.™se.A«-compone„-P-j^--^^^^^^ 
...„nndre.ononhei..e.^ 

ror::r;:n::::X-eo.et.o 
i::::rtr:::— 

as the Internet, and/or a wireless system. forth in detail certain 

.cMo.in.desc.ption — 
Utastrartve aspects of the tnvcntton These as 
a,e various ways in which the pnncples of the tnvcn on 
.vention isintended to tncludeal, such aspects and h«r^^^^^^^^^ 
5 novel features of the invention will become apparent fr m ftefolto 

of the invention when considered in conjunctton with the drawtngs. 

H iii fU n mr""""'""'"'' ' '"'"^ 

— ::!a:r:=^-^ 

acconiance with an aspect of the present invention; 
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Fig. 3 is a diagram Ulustfating a contour edge orientation within an image in 



accordance with an aspect ofthe present invention; 

Fig 4 is a diagram illustrating a resultant vector of a contour edge onentanon 
determination in accordance with ar, aspect ofthe present invention; 
5 Fig 5 is a dia^ Illustrating a contour edge offset determination in accordance wtth 

an aspect ofthe piesent invention; 

Fig. 6 is a diagram illustrating an interpolation in accordance w„h an aspect ofthe 

''^";r;;::dia.amillustrat,nganisotropicsmoothingwi.h,nanimageinacco^^^^ 

10 with an aspect ofthe present invention; 

Fig 8 is a diagram illustrating a subpixel area determination in accordance wtth an 

aspect of the present invention; 

Figgisaflowchartdiagramillustratingamethodologyforenabltngrmage 

extraction and smoothmtxing with anew backbond in accordance with an aspect ofthe 

" ''''^";::::':L.icbi„c.d,agramiiiust„t^^^ 

accordance with an aspect ofthe present invention. 

T)\ tiilrrt Pnf rir*^"" ^"^^ Invention 
The present invention is now described with reference to the drawings, wherein like 
reference numerals are used to refer to like elements throughout. 

The present invention relates to a system and methodology to facthtate r^oval o 
foregroundregio„ofanimage.omanassoci.tedbackgroundregionanatoe„ablesmo^^ 

mixtagoftheforegroundregionwiUrasecondandyorsubse,uenthackgroundreg,on.^.s 
maybeachievedbyselectingach.nand/or.oupingofpixelsde«nmsa»n^^^^^^^^^ 

foregro^rd region that is to be extracted from thehackground regron, and d termtmn a 
Ze.arealrthefo,.groundorbackgroundporti„nsofthecon.ourpixe^^ 
Thech.nofpixelsde«ning.heforegrou„dregio„ofd,eimagegen^lly,ncludesam^^^^^^ 

of both desired fore^und color, and background colors that are to be removed. A m,x,ng 
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„«„ known as alpha which defines .he mixing ratio of foregroond colors and background 
colors may be de.em,ined by computing the area of etther .he foreground region or .he 
background region wi.hi„ a coniour pixel. Suhpixel edge offsets may be uHlized a^ong me 
chain of pixels to detennine the proportion of area occupied by both .he foreground and 
background colors of the contour pixels. Upon determining alpha, .he ex.r.c.ed foreground 
image may be mixed with a subsequent background image wherein the pixel edges of the 
extracted image are mixed wiU, the new back^-ound image ac«,rding to the mixing raho 
defined by alpha. Thus, smooth mixing of fte exttacted foreg«,und with the subsequent 
background is achieved by determining alpha in accordance with the present invention. 

Referring initially to Fig. 1. a sy^em 10a illustrates an image processing system m 
accordance with an aspect of the present invention. An image 20a having both a foreground 
,egion20ba„dabackgroundregion20cisprocessedinaccordancewiththepr«ent 

invenfion, wherein the foreground region 20b is extmcted fi.m the image 20a and transferred 
,0 a second and/or subsequent image 30a, having a different background regton 30c. A 
contour definition system 40 is employed to define a chain or ^ouping of contour p.xels 50 
which are associated with the exterior of the fot^ground region 20b. The contour defln.hon 
system 40 maybe substantially any well-known system for selecting the contour prxels 50 of 
the foreground region 20b. Tlrese systems may include for example, "Intelligent Scsso. 
(as described in (Moriensen. E.N. and Barrett. W.A., •Wligent scissors for tmage 
composition" SIGGRAPH 95 Proceedings, 1995) as well as other suitable systems that 
provide foreground pixel contour defmirtons/selections. These systems enable a user and/or 
system to select/define the exterior of the foreground region 20b (e.g., mouse select.on, area 
defined by an overlaid object on the image) and output the chain or pooping of contour 
pixels 50 associated with the selection/definition of the foreground regron. 

Upon selecting the contour pixels 50 of the image 20a, a subpixel mixture analysis 
system 60 is employed to detemrine a mixing ratio alpha 64 to enable smooth mixing of the 
fore^ound region 20b with the backbond re^on 30c. By determining alpha 64, the amount 
offoreground color attributed to thecontour pixels 50maybe determined. Additionally.the 

mixing ratio alpha 64 enables smooth mixing of the background region 30c with the contour 
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. e,s50byenab«ngsubs.a».i**''»"^7°"° ^3 will b. desoibe. m n>o,e 

1 mav be determined by the ^^^^ be 

detail below, alpha may orientation, a subpixel edg 

""''"'^*;::l*ea.oae.en„>ne ,^ 3„,„„, an assorted 

a contour p.«l may be u .,,,0 of the contow pixels 50, Having 

Turning now to Fig. 2, a »bset O^^f ,„.e„t,on. « . 

^.ouredgeSOare — inac^da^-^^^^ 

• ,tPd that the contour pixels 50 may ^^^tour pixeis 

beappreciatedthat ^^^^^ed below. For example, th ^^^^^..^dge 

along the contour IS processed as as illustrated, a portion ot the 

rdU^^"-^'--"'°"""' ;S 2r«hetei„,bepixeU«-d,ebo*^ 
Jvetses^ugbpottionsofthepa..-^".^^^^^^^^^ 

::;oundte,o„saredep..edby.be.^^^^^^ 

'"•-::re::!:---°-^-'^i%.<--.B,.be.n. 

"'""j:::«be.odeM«neat.ya.M^^^^^^^^^^^ 

,,.l.eaetua.pi..a,ue,.i«»--^^^ 
;*ea>phava.ue*hrepr«ents,he™^.ig 
Si„ce.be.va>ue..o.n^.a.ve„™^e^g^^^^^^^^^^^^^ 

3„aB«bede.e™inedasdescnb^b.-^^^^^^^^ 
„,„r (or intensity value) that a pixei may ^ ^ p,, 

:J.^an.orc.t.ut„biec,(.S..---^^^^,^„^„,„,,^„.hef^^^^^^^ 
Becau.otimagesmoo,hness.>tmaybeexp. ^^^^^^^^,„„3,,alue. 

Ztthecontourpixe. 50(.., region— ^^^^ 

t,aceording.ooneaspeeto.hein«J.- ^^^^^^^^^ 
^^owedftommenearest foreground pixei. 
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wide noise sources. Gaussian sn,„o.hing is perfonned by convolving .he image 84 with a 

Gaussian operator which is defined below: 

Equation 1: 

wherein ^ is .he s.andard devia.ion rep«sen.ing .he wid.h of a Gaussian dis.nbu.ion. 
^eshapeof*edis«ibuHo„andhence.hean,o„n.ofs.oo.hingcanbeco— 

varying., toorder.o smoo.h an imageyix^), .he image may be convolved w,.h«(.^) 
produce a smoo.hed image s(xj.), wherein 

The edge „rie„.a«on (eg.. direCion *e con.our edge portion 86 is in relation .o .he 
,0 pixel 72d) may be de.ermined by .aWng ti,e gradien. of .he image 84 wi.h respec. .o .he 
:dVdirL.ionsdepic.edinPig.3ftom.hec„n.ourpixen2d.Thegradien.eomp^ 

Cbe direced a. in.ensi. values (1) a.ocia.ed wi.h each pixel 72d, 90a.«, for example 
as illustrated in Equation 2 below: 



15 Equation 2: 

VI(x, y) = 5I/5X \ + 9I/5y ] 

After delennining .he ^dien. of fte image 84 fiom .he cen.er of ,he pixel 72d. a 
^Itan, gradien. veCor ,00 as depiced in Fig. 4, defines .he orie„.tion of *e con.our edge 
:ion8r^e.adie„.vec.orlOO.spen>end,cular.o.heoHe„.ation„f.econ^^^^^ 

or.ion 86, since image in.ensi.y changes mos. rapidly in U,e direCon of .he edge. ~ 
e^gel041nemaybede.e™incd.hroushti.ecen.erof.hepixel72dwhieh,sparallel.„*e 
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i;:::r7ge..,,o„86andperpe„d.cular.o.hegrad.n.v.^^^^^^ 

Fig 4 .he comour edge portion 86 is generally offee. ^ .he cen.er of ,he ,xel ftus fc« 
d:e™ina.ions.nv„lveeompu.ing.heamoun.ofo,rse.re,uired.osh.ft.^^^^^^^^^ 

posi.,on of .he con.our edge portion 86. U^n dcennining fte amoun, of sh.ft for .he 
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possibilities for de.em>ining .he F value. For example, F values may be detennined .ia (1) 
an average of several nearby foreground pixels, (2) a stochastieally selected, werghted 
average of nearby pixels. (3) a pixel generated by a texture reconstruction process apphed to 
neatby foreground pixels, as well as (4) a mixture of the I value and the pixel value generated 

by any of (1-3)) above. 

Alpha is then determined by computing the area occupied by F within each contour 
pixel 72a-72f, which is described in more detail below. For example, the ratio of the area 74a 
occupied by the foreground F in the pixel 72d divided by the combined area of the pixel 72d 
yields the mixing ratio alpha. Since the area of the pixel 72d may be normalized to one, 
alpha may be determined as the area occupied by F. It is to be appreciated that similar 
determinations may occur for the background regions B, wherein background colors are 
selected for B as described above for selecting colors associated with F. Alpha is then 
determined as 1 minus the fraction of the pixel that overlaps the background side of the Ime 
drawn with computed orientation and offset and F is determined by substitution of I, «, B 
into the linear model 1 = oF + (l-a)B. As will be described in more detail below, subpixel 
edge orientations are determined for the contour pixels 50 which enable a contour edge offset 
to be computed such as for the areas 74a and/or 74b to yield a value for alpha. 

Referring now to Fig. 3, an exemplary subpixel edge orientation determination is 
illustrated in accordance with an aspect of the present invention. An image 84 is depicted 
having the pixel 72d with a contour edge portion 86 adjacent to nearby neighbonng pixels 
90a-90h, wherein a dark region within each pixel represents the intensity value of the pixel at 
the center of the pixel. It is to be appreciated that more or less pixels may be employed m 
determining the edge orientation and subsequent edge offset in accordance with the present 
invention. It is further to be appreciated that the following description for determining 
subpixel edge orientations and offsets are but one of many well-known image processing 
techniques for determining the contour edge orientation within a pixel and associated edge 
offset within a pixel, if any. It is noted that before image processing is commenced, a 
Gaussian smoothing function may be applied to the image 84 in order to filter potential pixel- 
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104, an area 106 may then be determined for the foreground portion of the pixel 72d which 

defines the mixing ratio alpha. 

Turning now to Fig. 5, one possible edge offset determination is illustrated in 
accordance with the present invention. Since the edge line 104 that was determined from the 
5 gradient vector computation above is through the center of the pixel 72d, a shift 

determination is performed to determine how far the edge line 104 is from the actual contour 
edge portion 86. This may be achieved by computing gradient magnitude points along the 
gradient vector 100 and fitting a curve 1 10a to the points, for example. By determining how 
far a peak 11 Ob of the curve 1 10a is from the center of the pixel 72d, an offset for the line 

10 1 04 may be computed. 

To fijrther illustrate the offset determination, three exemplary gradient magnitude 
points 1 12a- 1 12c are illustrated along the gradient vector 100. It is to be appreciated that a 
plurality of points along the vector 100 may be similarly determined. It is fiirther noted that 
the gradient magnitude points may be determined at equal pixel distances away (e.g., 1 ,2,3 

15 pixel distances) and/or at subpixel distance away {e.g., 1/3,1/2, 2/3 pixel distances) from the 
center of the pixel 72d. The gradient magnimde points 1 12a- 1 12c may be computed from the 
following Equation: 



20 



Equation 3: 



|VI(x, y) 1= ylidl/dx)' +(ai/ay) 



It is also noted that gradient magnitude points along the gradient vector 100 generally 
do not fall at the center of adjacent/neighboring pixel locations. Thus, some form of 
interpolation is generally performed in order to determine a gradient magnitude value that is 
25 offset from the center of a pixel. For example, referring briefly to Fig. 6, one possible 

interpolation process is illustrated. As illustrated, the gradient magnitude points 1 12a and 
1 12c do not fall at the center points of neighboring pixels 90d and 90e, respectively. Thus, 
bilinear interpolation may be performed wherein the center pixel values from pixels 90a, 90b, 
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90d and 72d are employed to compute the gradient magnitude at point 1 1 2c. Similarly, the 
center pixel values from pixels 90b, 90c, 90e and 72d are employed to compute the gradient 
magnitude at point 1 12a. It is to be appreciated that other well-known interpolation processes 
may be employed to determine intermediate gradient magnitude values along the vector 100. 
5 For example, bi-cubic interpolation may be employed wherein the values from 16 
neighboring pixels are utilized to determine off-center gradient magnitude values. 

Referring back to Fig. 5, upon determining the gradient magnitude points 1 12a-l 12c, 
the curve 1 10a is fit to the gradient magnitude points. For example, a quadratic curve may be 
fit to the points 1 12a-l 12c. It is to be appreciated that substantially any curve fitting 
1 0 technique may be employed to fit the curve 1 1 Oa such as a higher order polynomial and/or 
regression technique. After the curve 1 10a has been fit to the gradient magnitude points, the 
peak 1 10b of the curve 1 10a generally is aligned with the intersection of the subpixel contour 
edge portion 86 and the gradient vector 100. The edge line 104 which is through the center 
of the pixel 72d is then offset by an amount "D" along the curve 1 10a to the contour edge 
1 5 portion 86. As will be described in more detail below in relation to Fig. 8, upon determining 
the edge offset, an area computation may be performed to determine the mixing ratio alpha. 

Referring briefly to Fig. 7, an optional anisofropic smoothing may be applied to the 
image along the vector 104 during the gradient magnitude determinations described above. 
This step involves taking a plurality of image samples 1 1 8a-l 1 8f, for example, along the 
20 gradient vector 100 and parallel to the direction of the edge. For example, samples 1 1 8a and 
1 1 8d are parallel to samples 1 1 8b and 1 1 8e, which are parallel to the contour edge portion 
86. It is to be appreciated that other samples may similarly be determined. Anisotropic 
smoothing, which is well understood, involves averaging gradient magnitude values that are 
in line with the parallel samples. The averaging may also be weighted by a Gaussian 
25 fianction, wherein the center values 1 1 2a, 1 1 2b, and 1 1 2c are emphasized over other 
neighboring values. 

Referring now to Fig. 8, a subpixel area determination is illustrated for determining 
the mixing ratio alpha in accordance with the present invention. After determining the edge 
offset as described above, a foreground area portion Fa 120 may be defined for the portion of 
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the foreground that is mixed at the subpixel level within the pixel 72d. The foreground area 
portion 120 is defined by the contour edge portion 86 determined above, and sides 122a and 
122b that are intersected by the contour edge portion 86. The foreground area 120 may thus 
be determined by integrating the function defined by the contour edge portion 86 over the 
5 region encompassed by the sides 122a and 122b of the pixel 72d. The mixing ratio alpha is 

then the ratio of the computed area 120 divided by the entire area of the pixel 72d. Since the 
area of the pixel may be normalized to unity, the area 120 is thus alpha. As described above, 
a background area portion Ba 1 26 may be similarly computed as the foreground portion 1 20. 
In this case however, alpha would then determined as 1 minus the fraction of the pixel that 

10 overlaps the background side of the line drawn with computed orientation and offset. 

Fig. 9 illustrates a methodology for providing smooth image mixing in accordance 
with an aspect of the present invention. While, for purposes of simplicity of explanation, the 
methodology is shown and described as a series of blocks, it is to be understood and 
appreciated that the present invention is not limited by the order of blocks, as some blocks 

15 may, in accordance with the present invention, occur in different orders and/or concurrently 

with other blocks fi'om that shown and described herein. For example, those skilled in the art 
will understand and appreciate that a methodology could alternatively be represented as a 
series of interrelated states, such as in a state diagram. Moreover, not all illustrated blocks 
may be required to implement a methodology in accordance with an aspect of the present 

20 invention. 

Referring to Fig. 9, and proceeding to block 150, a set and/or chain of contour pixels 
is selected, wherein the perimeter of the foreground region within an image is identified as 
described above. At block 1 54, a subpixel edge offset determination is performed on each 
contour pixel selected in block 1 50. As described above, an edge orientation may first be 
25 determined by taking the gradient of the image with respect to each contour pixel. Once the 

edge orientation has been determined, the edge offset may be determined by determining 
gradient magnitude values along the image gradient, and then applying a curve to the gradient 
magnitudes in order to determine the degree of offset the contour edge is from the center of 
the contour pixel. At block 158, an area is determined for the subpixel area defined by the 
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edge offset determined in block 1 54 and the sides of the contour pixels. After determining 
the subpixel area, an alpha value defining the mixing ratio of foreground and background 
colors may be determined as described above. At block 162, the alpha value is utilized to 
smoothly mix the selected foreground region of block 150 with a second and/or subsequent 
5 background region. 

In order to provide a context for the various aspects of the invention, Fig. 1 0 and the 
following discussion are intended to provide a brief, general description of a suitable 
computing environment in which the various aspects of the present invention may be 
implemented. While the invention has been described above in the general context of 

10 computer-executable instructions of a computer program that runs on a computer and/or 

computers, those skilled in the art will recognize that the invention also may be implemented 
in combination with other program modules. Generally, program modules include routines, 
programs, components, data structures, etc. that perform particular tasks and/or implement 
particular abstract data types. Moreover, those skilled in the art will appreciate that the 

1 5 inventive methods may be practiced with other computer system configurations, including 

single-processor or multiprocessor computer systems, minicomputers, mainframe computers, 
as well as personal computers, hand-held computing devices, microprocessor-based or 
programmable consumer electronics, and the like. The illustrated aspects of the invention 
may also be practiced in distributed computing environments where tasks are performed by 

20 remote processing devices that are linked through a communications network. However, 
some, if not all aspects of the invention can be practiced on stand-alone computers. In a 
distributed computing environment, program modules may be located in both local and 
remote memory storage devices. 

With reference to Fig. 10, an exemplary system for implementing the various aspects 

25 of the invention includes a conventional computer 220, including a processing unit 22 1 , a 

system memory 222, and a system bus 223 that couples various system components including 
the system memory to the processing unit 22 1 . The processing unit 22 1 may be any of 
various commercially available processors. It is to be appreciated that dual microprocessors 
and other multi-processor architectures also may be employed as the processing unit 22 1 . 
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The system bus may be any of several types of bus structure including a memory bus 
or memory controller, a peripheral bus, and a local bus using any of a variety of conventional 
bus archite«ures. The system memory may include read only memory (ROM) 224 and 
random access memory (RAM) 225. A basic input/output system (BIOS), containing the 
basic routines that help to transfer infomration between elements within the computer 220, 
such as during start-up, is stored in ROM 224. 

The computer 220 further includes a hard disk drive 227, a magnetic d>sk dnve 228, 
. g. to read from or wdte to a removable disk 229, and an optical disk drive 230. e.g.. for 
reading from or writing to a CD-ROM disk 23 1 or to read from or write to other optical 
media The hard disk drive 227. magnetic disk drive 228, and optical disk drive 230 are 
connected to the system bus 223 by a hard disk drive interface 232, a magnetic dtsk drrve 
interface 233, and an optical drive interface 234. respectively. The drives and thetr 
associated computer-readable media provide nonvolatile storage of data, data structitres, 
computer-executable instructions, etc. for the computer 220. Although the description of 
1 5 computer-readable media above refers to a hard disk, a removable magnetic disk and a CD U 
should be appreciated by those skilled in the art that other types of media which are readable 
by a computer, such as magnetic easseties. flash memory c^ds. digital video disks. Bemoulh 
cartridges, and the like, may also be used in the exemplary operating enviromnent, and 
ftrther that any such media may contain computer-executable instructions for perfotmrng the 

20 methods of the present invention. 

A number of program modules may be stored in the drives and RAM 225, ineludmg 
an operating system 235, one or more application pro-ams 236, other program modules 237, 
and pro^ data 238. It is noted that ttte op^ting system 235 in the illustrated computer 
may be substantially any suitable operating system. 
25 A user may enter commands and infonnation into the computer 220 through a 

key^ard 240 and a pointing device, s«ch as a mouse 242. Other input devices (not shown) 
may include a mictophone, a joystick, a game pad. a satellite dish, a scanner, or the hke. 
These and other input devices are often connect,.! to the processing unit 22 1 through a senal 
port interface 246 that is coupled ,0 the system bus, but may be comtected by other interfaces. 
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such as a parallel port, a game port or a universal serial bus (USB). A monitor 247 or other 
type of display device is also connected to the system bus 223 via an interface, such as a 
video adapter 248. In addition to the monitor, computers typically include other peripheral 
output devices (not shown), such as speakers and printers. 
5 The computer 220 may operate in a networked environment using logical connections 

to one or more remote computers, such as a remote computer 249. The remote computer 249 
may be a workstation, a server computer, a router, a peer device or other common network 
node, and typically includes many or all of the elements described relative to the computer 
220, although only a memory storage device 250 is illustrated in Fig. 10. The logical 

1 0 connections depicted in Fig. 1 0 may include a local area network (LAN) 25 1 and a wide area 
network (WAN) 252. Such networking environments are commonplace in offices, 
enterprise-wide computer networks, Intranets and the Internet. 

When employed in a LAN networking environment, the computer 220 may be 
connected to the local network 251 through a network interface or adapter 253. When 

1 5 utilized in a WAN networking environment, the computer 220 generally may include a 

modem 254, and/or is connected to a communications server on the LAN, and/or has other 
means for establishing communications over the wide area network 252, such as the Internet. 
The modem 254, which may be internal or external, may be connected to the system bus 223 
via the serial port interface 246. In a networked environment, program modules depicted 

20 relative to the computer 220, or portions thereof, may be stored in the remote memory storage 
device. It will be appreciated that the network connections shown are exemplary and other 
means of establishing a communications link between the computers may be employed. 

In accordance with the practices of persons skilled in the art of computer 
programming, the present invention has been described with reference to acts and symbolic 

25 representations of operations that are performed by a computer, such as the computer 220, 

unless otherwise indicated. Such acts and operations are sometimes referred to as being 
computer-executed. It will be appreciated that the acts and symbolically represented 
operations include the manipulation by the processing unit 22 1 of electrical signals 
representing data bits which causes a resulting transformation or reduction of the electrical 
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signal representation, and the maintenance of data bits at memory locations in the memory 
system (including the system memory 222, hard drive 227, floppy disks 229, and CD-ROM 
231) to thereby reconfigure or otherwise alter the computer system's operation, as well as 
other processing of signals. The memory locations wherein such data bits are maintained are 
5 physical locations that have particular electrical, magnetic, or optical properties 

corresponding to the data bits. 

What has been described above are preferred aspects of the present invention. It is, of 
course, not possible to describe every conceivable combination of components or 
methodologies for purposes of describing the present invention, but one of ordinary skill in 
10 the art will recognize that many further combinations and permutations of the present 

invention are possible. Accordingly, the present invention is intended to embrace all such 
alterations, modifications and variations that fall within the spirit and scope of the appended 
claims. 
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